A measurement instrument for process modeling research : development, test and procedural model

Process modeling is an emergent area of Information Systems research that is characterized through an abundance of conceptual work with little empirical research. To fill this gap, this paper reports on the development and validation of an instrument to measure user acceptance of process modeling grammars. We advance an extended model for a multi-stage measurement instrument development procedure, which incorporates feedback from both expert and user panels. We identify two main contributions: First, we provide a validated measurement instrument for the study of user acceptance of process modeling grammars, which can be used to assist in further empirical studies that investigate phenomena associated with the business process modeling domain. Second, in doing so, we describe in detail a procedural model for developing measurement instruments that ensures high levels of reliability and validity, which may assist fellow scholars in executing their empirical research.

Self-neglect: development and evaluation of a self-neglect (SN-37) measurement instrument

Aim: To develop and evaluate the psychometric properties of an instrument for the measurement of self-neglect (SN).Conceptual Framework: An elder self-neglect (ESN) conceptual framework guided the literature review and scale development. The framework has two key dimensions physical/psycho-social and environmental and seven sub dimensions which are representative of the factors that can contribute to intentional and unintentional SN. Methods: A descriptive cross-sectional design was adopted to achieve the research aim. The study was conducted in two phases. Phase 1 involved the development of the questionnaire content and structure. Phase 2 focused on establishing the psychometric properties of the instrument. Content validity was established by a panel of 8 experts and piloted with 9 health and social care professionals. The instrument was subsequently posted with a stamped addressed envelope to 566 health and social care professionals who met specific eligibility criteria across the four HSE areas. A total of 341 questionnaires were returned, a response rate of 60% and 305 (50%) completed responses were included in exploratory factor analysis (EFA). Item and factor analyses were performed to elicit the instruments underlying factor structure and establish preliminary construct validity. Findings: Item and factor analyses resulted in a logically coherent, 37 items, five factor solution, explaining 55.6% of the cumulative variance. The factors were labelled: ‘Environment’, ‘Social Networks’, ‘Emotional and Behavioural Liability’, ‘Health Avoidance’ and ‘Self-Determinism’. The factor loadings were >0.40 for all items on each of the five subscales. Preliminary construct validity was supported by findings. Conclusion: The main outcome of this research is a 37 item Self-Neglect (SN-37) measurement instrument that was developed by EFA and underpinned by an ESN conceptual framework. Preliminary psychometric evaluation of the instrument is promising. Future work should be directed at establishing the construct and criterion related validity of the instrument.

Towards an information society measurement instrument for Latin America and the Caribbean: getting started with census, household and business surveys

Includes bibliography

Extended studies on fibre diameter measurement with OFDA instrument

OFDA 2000 is a widely used fibre diameter measurement instrument. The instrument can provide improved statistical accuracy measurements in comparison with traditional technology. In this paper, a new technique has been developed to enable fibre diameters to be measured in an aqueous environment using the OFDA 2000 instrument. This new technique was utilised to assess the effects of pH and temperature on the diameters of Merino wool fibres in aqueous environments. Significant changes in fibre diameter under aqueous conditions were found as a function of pH and temperature. It is also demonstrated in this paper that the fibre diameter measurement results can be affected by fibre colour. In both dry and aqueous conditions, variation in fibre diameter was observed on fibres with different colours. This could be due to an optical effect or more likely due to physical changes in the dyed fibres as a result of the presence of dyes. Apart from their physical bulk, dyes may also affect the water content of fibres and hence have an influence on the swelling of fibres when they are measured under ambient regain and wet conditions.

A balanced scorecard approach to enterprise systems performance measurement

A range of influences, both technical and organisational, has encouraged the wide spread adoption of Enterprise Systems (ES). Nevertheless, there is a growing consensus that Enterprise Systems have in many cases failed to provide expected benefits. The increasing role of, and dependency on ES (and IT in general), and the ‘uncertainty’ of these large investments, have created a strong need to monitor and measure ES performance. This paper reports on a research project aimed at deriving an ‘Enterprise Systems benefits measurement instrument’. The research seeks to identify how Enterprise Systems benefits can be usefully measured, with a ‘balance’ between qualitative and quantitative factors.

Developing sustainable IT-related capabilities : instrument development and test

Research has established that firms' IT-related capabilities at a point in time explain IT-related performance differences across firms. IT resources, however, are dynamic, and evolve at an exponential rate. This means we need to understand how to sustain firms' existing capabilities to leverage opportunities offered by new IT resources. Wet suggests a higher-level resource that can sustain firms' existing IT-related capabilities. Second, we report on the development of a valid and reliable measurement instrument for measuring this higher-level resource in four stages, which includes expert feedback and a field test. The validated instrument would be useful in extending the IT business value studies to investigate how firms can sustain their IT-related capabilities. This effort will provide a deeper understanding of how firms can secure sustainable IT-related business value from their acquired IT resources.

Realizing benefits from enterprise architecture : a measurement model

Enterprise architecture (EA) management has become an intensively discussed approach to manage enterprise transformations. Despite the popularity and potential of EA, both researchers and practitioners lament a lack of knowledge about the realization of benefits from EA. To determine the benefits from EA, we explore the various dimensions of EA benefit realization and report on the development of a validated and robust measurement instrument. In this paper, we test the reliability and construct validity of the EA benefit realization model (EABRM), which we have designed based on the DeLone & McLean IS success model and findings from exploratory interviews. A confirmatory factor analysis confirms the existence of an impact of five distinct and individually important dimensions on the benefits derived from EA: EA artefact quality, EA infrastructure quality, EA service quality, EA culture, and EA use. The analysis presented in this paper shows that the EA benefit realization model is an instrument that demonstrates strong reliability and validity.

Development and validation of an instrument to measure organizational cultures' support of business process management

The purpose of Business Process Management (BPM) is to increase the efficiency and effectiveness of organizational processes through improvement and innovation. Despite a common understanding that culture is an important element in these efforts, there is a dearth of theoretical and empirical research on culture as a facilitator of successful BPM. We develop the BPM culture construct and propose a validated instrument with which to measure organizational cultures’ support of BPM. The operationalization of the BPM culture concept provides a theoretical foundation for future research and a tool to assist organizations in developing a cultural environment that supports successful BPM.

Effect of the interfacial area measurement parameters on the push-out strength between fiber post and dentin

Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP)

Measuring nursing competencies in the operating theatre: instrument development and psychometric analysis using Item Response Theory

BACKGROUND: Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. RESEARCH AIM: The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. RESEARCH METHOD: The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. RESULTS: Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. CONCLUSION: The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice.

Measuring the use of information and communication technologies (ICTs) in the classroom

In 2003, the “ICT Curriculum Integration Performance Measurement Instrument” was developed froman extensive review ofthe contemporary international and Australian research pertaining to the definition and measurement of ICT curriculum integration in classrooms (Proctor, Watson, & Finger, 2003). The 45-item instrument that resulted was based on theories and methodologies identified by the literature review. This paper describes psychometric results from a large-scale evaluation of the instrument subsequently conducted, as recommended by Proctor, Watson, and Finger (2003). The resultant 20-item, two-factor instrument, now called “Learning with ICTs: Measuring ICT Use in the Curriculum,” is both statistically and theoretically robust. This paper should be read in association with the original paper published in Computers in the Schools(Proctor, Watson, & Finger, 2003) that described in detail the theoretical framework underpinning the development of the instrument.

Measuring cognitive and dispositional characteristics of creativity in elementary students

This article describes the theoretical underpinning and development of a measurement instrument that provides teachers with a tool to observe the personal creativity characteristics of individual students. The instrument was developed by compiling a list of characteristics derived from the literature to be indicative of the personal characteristics of creative people. The list was then reduced by grouping like characteristics to 9 cognitive and dispositional traits that were considered appropriate for elementary students. The 9-item instrument was then administered in 24 classrooms to 520 Year 6 and Year 7 students. Factor analysis using maximum likelihood extraction with an oblimin rotation revealed a single factor with an eigenvalue greater than 1 and accounting for 63% of the variance. All 9 items on this factor loaded at .72 or greater. The results indicated that the Creativity Checklist has very high internal consistency and is a reliable measurement instrument (a = .93).

Construction performance and organisational culture

The purpose of this paper is to summarize the outcomes of a detailed research study carried out as part of the fulfilment of a doctoral programme which examined the relationships between, and impacts of organisational culture on construction performance within a Hong Kong context. The research used a mixed methodology approach consisting of an organisational culture survey using an adapted validated and reliable measurement instrument (the Denison Organisational Culture Survey), mini-case studies in four Hong Kong construction companies and correlated the derived culture scores against performance scores measured by the Hong Kong Housing Department Performance Assessment Scoring System (PASS). The significance of the research was to advance knowledge of the importance of organisational culture strength as a performance driver in the construction industry and the further proof of the culture performance links using a set of measures of the latter which were not financially-based. The findings of the research make a contribution to theory by further validating the work by Denison (1990) and others, not only in that a successful link between organisational culture and performance was demonstrated, but it also identifies particular cultural factors in organisations that appear to be significantly responsible for achieving successful outcomes and reveals opportunities for further research into the organisational culture of construction companies Keywords: organisational culture, construction performance, business success.

“Entrepreneurial management” as a strategic choice in firm behavior : linking it with performance

Establishing the core principals of “entrepreneurial management” within an organization describes a certain strategic choice that affects a company in six dimensions, according to Stevenson (1983). Our aim is to empirically measure entrepreneurial management (it’s existence and degree) and to link this measured strategic choice (for or against) entrepreneurial management with firm performance. Our argument here is that companies that follow core principals of entrepreneurial management should outperform other more administrative firms in certain measures of strategic performance. This paper builds on an empirical investigation published by Brown, Davidson & Wiklund (2001), who have developed and tested a reliable measurement instrument for Stevenson’s definition of “entrepreneurial management” (Stevenson 1983, Stevenson & Jarillo 1990). In the first part of our paper we aim to replicate and to some extent improve this study. In the second part we link the measured degree of “entrepreneurial management” with firm performance. To our knowledge, even so Stevenson’s definition of entrepreneurial management is commonly acknowledged and Brown et al. (2001) developed a reliable instrument to empirically capture this behavioral approach to management, the construct of entrepreneurial management never before has been linked to firm performance in an empirical study. Since most papers on corporate entrepreneurship and firm performance are based on Covin & Slevin’s (1991) or Miller’s (1983) concept of entrepreneurial orientation, we contribute to the literature on corporate entrepreneurship in a novel way, given the fact that the entrepreneurial management dimensions measured in our study can theoretically and empirically be clearly distinguished from the construct of entrepreneurial orientation as defined by Covin & Selvin (1991).